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1 . The request filed on June 27, 2003 for a Request for Continued Application (RCE) is 
acceptable and a RCE has been established. An action on the RCE follows. 

2. Claims 15-29, 43, 44, 46, 47, and 57-62 are objected to because of the following 
informalities: 

(1) claim 15, line 9, after "combinations"* "," should be changed to 

(2) claim 43, line 9, after "index, "," should be properly inserted for clarity; 

(3) claim 46, line 17, "„" should be changed to "," for clarity; 

(4) . Appropriate correction is required. 

3. The following is a quotation of the first-paragraph of 35 U.S.C. 1 12: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 

4. Claims 1-13, and 15-62 are rejected under 35 U.S.C. 1 12, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one skilled in the 
relevant art that the inventor(s), at the time the application was filed, had possession of the 
claimed invention. 

The Specification does not provide support for the newly amended features of "said first 
and second data acquisition methods being respectively different illumination type" as claimed in 
claims \f\s)30, 38, 39, and 45; "said different image gathering methods being respectively 
different illumination type" as claimed in claim 40; "said first and second data acquisition modes 
being respectively different illumination type as claimed in claim 42; "said imaging methods 
being respectively different illumination type" as claimed in claim 43; "said image gathering 
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methods being respectively different illumination type" as claimed in claim 46; "said different 
imaging methods being respectively different illumination type" as claimed in claim 48; and 
"wherein one of said data acquisition methods uses reflected light and the other of said data 
acquisition methods uses transmitted light" as claimed in clainjis 55and.61, respectively. 

5. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a whole 
would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

6. Claims 1-8, 11-13, 15-21, 23-31, 34, 35, 38-49, 51, 53, 55-57, 59, 61, and 62 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over Bacus et al of record (6,101,265) in view of 
Kley (4,806,776) and Engelhardt (6,529,271). 

Bacus et al discloses a method and apparatus for acquiring and reconstructing magnified 
specimen images from a computer controlled microscope as shown in Figures 1-11, and 
substantially the same data acquisition and display system, image data storage device, acquisition 
and display coordinator and method, method of display of data acquired in at least two data 
acquisition methods from a scannable field of interest, method of constructing an image 
gathering and display coordination system, control system for controlling an image data 
acquisition device, a control system for controlling an imaging device and a display device, a 
method of applying an intrinsic coordinate system to a mount and object system, and a method of 
imaging a mount and object system using an intrinsic coordinate system as claimed in claims 1- 
8, 11-13, 15-21, 23-31, 34, 35, and 38-49, comprising substantially the same at least one data 
acquisition device (i.e., 16 of Figure 5), operable to acquire field image data of a presently 
viewed field having field location data (see column 3, line 17 to column 4, line 29, column 4, 
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line 65 to column 5, line 19, column 7, line 16-48, column 11, lines 14-42, column 1 1, line 62 to 
column 12, line 5), from a scannable field of interest using each of at least a first and a second 
data acquisition method (see 24, 26, 28 of Figures 1-3, and column 7, lines 16-48), the data 
acquisition device is operable to acquire image data of a presently viewed field using a second 
data acquisition method and the field data display device is operable to display the image data in 
real time in conjunction with a corresponding image acquired using the first data acquisition 
method (see 24, 26, 28 of Figures 1-3, and column 7, lines 16-48), the data acquisition device is 
a microscope (i.e., 16 of Figure 5) being one of a group comprising a light microscope, a 
scanning electron microscope, and a transmission electron microscope, and the data acquisition 
device is terrestrially based (see Figure 5), the data acquisition device is any one of a group 
comprising a thermal imager, an image intensified, a telescope, a camera and a radar (see camera 
14 of Figure 5); a field data storage device (column 8, lines 26-36, column 9, lines 36-58) for 
storing the field data together with field location data corresponding thereto, the field data 
storage device is operable to store image data of an entirety of the scannable field of interest 
acquired according to the first data acquisition method, the storage device storing image data of a 
plurality of parts of a scannable field of interest together with location data of the part within the 
scannable field of interest; field data display device (see Figures 1-3) being operable to display 
simultaneously field data of the presently viewed field, acquired respectively by the first and 
second data acquisition method, the field data being matchable by the field location data (see 
column 7, lines 16-48, column 8, lines 27-67); wherein the scannable field of interest is 
substantially larger than the presently viewed field such that a plurality of viewed fields are 
required to cover the scannable field of interest (see 24, 26 of Figures 1-3, column 7, lines 16-48, 
column 8, lines 27-67); the acquisition and display coordinator for coordinating between at least 
one image data acquisition device, the coordinator operable to position the data acquisition 
device, monitor positioning of the data acquisition device (see Figures 4 and 5), wherein the 
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location data additionally comprises focussing data for defining a focal plane (see Abstract, 
column 2, lines 28-47); software on computer readable media for installation on a computer 
operatively associated with the data acquisition device (see Figures 4 and 5); forming a plurality 
of first images of the field of interest (i.e., low magnification of images, see column 3, lines 33- 
42, column 4, line 31 to column 5, line 58), indexing the images (i.e., selected points of interest 
are provided with a marker, see column 4, line 65 to column 5, line 18, column 8, lines 61-67, 
column 11, line 62 to column 12, line 5), storing the indexed images (see column 11, lines 14-42, 
column 9, lines 36-58, column 11, lines 30-42), scanning the field of interest using a second data 
acquisition method (i.e., high magnification of images, see column 3, lines 33-42, column 4, line 
31 to column 5, line 58) to form at least one second image corresponding to the one of the first 
images, indexing the at least one second image (i.e., selected points of interests are provided with 
a marker, see column 4, line 65 to column 5, line 18, column 8, lines 61-67, column 11, line 62 
to column 12, line 5), determining from the indices which of the first images corresponds to the 
second image, and simultaneously displaying the second image and the corresponding first 
image (see column 3, line 17 to column 4, line 29, column 4, line 65 to column 5, line 19, 
column 7, line 16-48, column 11, lines 14-42, column 11, line 62 to column 12, line 5); 
providing an image gathering device operable to gather image data, using a plurality of image 
gathering methods, according to externally provided positioning commands, providing an image 
storing device and connecting the image storing device to the image gathering device such that 
the image storing device is able to store data gathered from the image gathering device in 
association with the externally provided positioning commands corresponding to the data, and 
providing an image display device for simultaneously displaying a plurality of images gathered 
using different image gathering methods but with identical positioning commands (see Figures 1- 
5, column 7, lines 16-48, columns 8-9); the control system for permitting a user to move over a 
field of interest with the imaging device to image the field in parts using one imaging method, to 
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index each part with a current location of the imaging device (i.e., selected points of interests are 
indexed with markers and with the aid of a mouse, see column 4, line 65 to column 5, line 18, 
column 8, lines 61-67, column 1 1, line 62 to column 12, line 5) and to display a current part of 
the display device whilst simultaneously and automatically displaying a second image of a same 
part of the field previously obtained using a different imaging method (i.e., region 30 as provided 
in low magnification may also be displayed when reproduced at high magnification within 
window 26 of Figure 1, see column 7, lines 16-48) and indexed using a then current location of 
the imaging device (i.e., selected points of interests are indexed with markers and with the aid of 
a mouse, see column 4, line 65 to column 5, line 18, column 8, lines 61-67, column 11, line 62 to 
column 12, line 5), the second image being automatically replaced as the imaging device moves 
to a different part of the field of interest using a respective index (see Figures 1-5 and columns 7- 
9); the imaging device is operable to image the field of interest using at least three imaging 
methods and wherein the display device is operable to display simultaneously all images of a 
part of the field of interest currently being viewed (see 24, 26, 28 of Figures 1-3); identifying a 
plurality of edge points in the mount and object system using automatic image processing, 
interpolating straight lines between the edge points, identifying two perpendicular straight lines 
from the interpolated straight lines, identifying a meeting point between the perpendicular 
straight lines, defining the meeting point as an origin for the intrinsic coordinate system, using 
the coordinate system to provide automatic cross-referencing between the points on the object 
imaged, the mount an object system has a substantially rectangular outline, making a plurality of 
images at different locations on the mount and object system, and indexing the images based on 
its respective location expressed in terms of the intrinsic coordinate system (i.e., editing and 
positioning the XY step size, see rectangular boundary within point 290 of Figure 1 1, see column 
3, line 43 to column 4, line 16, column 9, line 36 to column 10, line 59, column 11, line 14 to 
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column 12, line 5); wherein the data acquisition device is adapted for gathering data of a 
microscopic scale biological entity (see column 2, lines 48-64). 

Bacus et al does not particularly disclose, though, the followings: 

(a) wherein the first and second data acquisition methods being respectively different 
illumination type, illumination path, marking and data gathering combinations, wherein one of 
the data acquisition methods uses reflected light and the other of the data acquisition methods 
uses transmitted light, providing co-ordinated viewing of points of the object imaged using 
different image gathering methods, using the co-ordinate system to provide automatic cross- 
referencing between the points on the object imaged using the different image gathering 
methods, and providing correspondence between regions on the object when imaged by different 
imaging methods as claimed in claims 1,15, 30, 38, 39, 40, 42, 43, 45, 46, 48, 55, and 61; 

(b) wherein one of the data acquisition methods is a bright field data acquisition method, 
and wherein one of the data acquisition methods uses ultra-violet illumination as claimed in 
claims 53, 56, 59, and 62 ;and 

(c) wherein the data acquisition device is suitable for being airborne and spaceborn as 
claimed in claims 12, 13, 24, and 25. 

Regarding (a), Kley discloses an electrical illumination and detecting apparatus as shown 
in Figures 1, 81, 91, 93, 100-1 12, and teaches the conventional use of different illuminations, 
markings, and data gathering combinations for the imaging and detecting systems (see Figures 1 , 
81, 91, 93, and 100-1 12, column 36, lines 20-63, column 38, lines 13-37, column 39, line 56 to 
column 40, line 6, column 40, lines 15-28, column 42, line 57 to column 43, line 2), and the 
illumination of samples either with transmissive or reflective light (see column 9, lines 56-68). 
In view of the particular teachings of Kley involving selective reflective and transmissive 
lighting techniques as shown in Figures 1, 56-58, 81,91, 93, and 100-1 12, it is therefore 
considered obvious to provide a transmissive light to one of the data acquisition methods of 
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Bacus et al while providing the reflective light to the other of the data acquisition methods of 
Bacus et al. It is also noted that Kley fails to disclose that the first and second data acquisition 
methods are respectively different illumination type and illumination path as claimed. However, 
Engelhardt discloses a method of finding, recording and evaluating object structures as shown in 
Figure 4, and teaches the conventional first and second data acquisitions (i.e., 2a and 2b of 
Figure 4) respectively provided with different illumination type and path (see column 3, lines 59- 
67, column 4, lines 31-56, column 6, lines 39-62). Therefore, it would have been obvious to one 
of ordinary skill in the art, having the Bacus et al, Kley, and Engelhardt references in front of 
him/her and the general knowledge of illumination and data gathering techniques in an image 
data acquisition system, would have had no difficulty in providing the selective reflected and 
transmissive lights as taught by Kley respectively to the data acquisition methods of Bacus et al 
as well as providing different illumination type, illumination path, marking and data gathering 
combination systems as taught by the combination of Kley and Engelhardt as the specific means 
for picking up the first and second images of Bacus et al for further displaying of the images as 
acquired for the same well known image acquisition and display purposes as claimed. 

Regarding (b), the particular use of bright field data acquisitions and ultra-violet 
illuminations are however old and well recognized in the art, as exemplified by Kley (see column 
7, lines 28-30, column 39, lines 22-32). Therefore, it would have been obvious to one of 
ordinary skill in the art, having the Bacus et al, Kley, and Engelhardt references in front of 
him/her and the general knowledge of the different types of illuminations, would have had no 
difficulty in providing the bright field and/or ultra violet illuminations as taught by Kley for the 
pickup system of Bacus et al for the same well known illuminations purposes as claimed. 

Regarding (c), the Examiner takes Official Notice that the data acquisition device of 
Bacus et al may be provided airborne and spaceborn so as to provide substantially the same if not 
the same services in a different environment as desired. Therefore, it would have been obvious 
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to one of ordinary skill in the art, having the Bacus et al reference in front of him/her and the 
general knowledge of the use of devices in different environments, would have had no difficulty 
in providing the data acquisition device of Bacus et al in the airborne and spaceborn 
environments for the same well known purposes as claimed. 

7. Claims 9, 10, 22, 36, and 37'are rejected under 35 U.S.C. 103(a) as being unpatentable 
over the combination of Bacus et al, Kley, and Engelhardt (6,529,271) as applied to claims 1-8, 
11-13, 15-21, 23-31, 34, 35, 38-49, 51, 53, 55-57, 59, 61, and 62 in the above paragraph (6), and 
further in view of Trulson et al of record (6,025,601). 

The combination of Bacus et al, Kley, and Engelhardt discloses substantially the same 
data acquisition and display system, image data storage device, acquisition and display 
coordinator and method, method of display of data acquired in at least two data acquisition 
methods from a scannable field of interest, method of constructing an image gathering and 
display coordination system, control system for controlling an image data acquisition device, a 
control system for controlling an imaging device and a display device, a method of applying an 
intrinsic coordinate system to a mount and object system, and a method of imaging a mount and 
object system using an intrinsic coordinate system as above, but does not particularly disclose 
wherein the data acquisition device is a telescope, wherein the telescope is any one of a group 
comprising a refracting telescope, a reflecting telescope, an infra-red telescope, a radio telescope, 
a gamma-ray telescope, and an x-ray telescope, wherein the at least'one of the first and second 
data is acquired using a member of a group comprising a telescope and a thermal imaging 
device, the member being operable to gather data at a plurality of different wavelengths and 
wherein each data acquisition method comprises gathering data at a different one of the 
wavelengths as claimed in claims 9, 10, 22, 36, and 37. However, Trulson et al discloses a 
method and apparatus for imaging a sample on a device as shown in Figure 3, and teaches the 
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conventional use of providing a telescope system with a microscope objective for expanding the 
excitation light to the desired diameter (see column 3, lines 14-26, column 29, lines 23-32). 
Therefore, it would have been obvious to one of ordinary skill in the art, having the Bacus et al, 
Kley, Engelhardt, and Trulson et al references in front of him/her and the general knowledge of 
imaging techniques, would have had no difficulty in providing the telescope of Trulson et al as 
the data acquisition device of Bacus et al for the same well known imaging purposes as claimed. 

8. Claims 32 and 50 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Bacus et al, Kley, and Engelhardt as applied to claims 1-8, 1 1-13, 15-21, 23-31, 
34, 35, 38-49, 51, 53, 55-57, 59, 61, and 62 in the above paragraph (6), and further in view of 
Spigarelli et al of record (5,627,913). 

The combination of Bacus et al, Kley, and Engelhardt discloses substantially the same 
data acquisition and display system, image data storage device, acquisition and display 
coordinator and method, method of display of data acquired in at least two data acquisition 
methods from a scannable field of interest, method of constructing an image gathering and 
display coordination system, control system for controlling an image data acquisition device, a 
control system for controlling an imaging device and a display device, a method of applying an 
intrinsic coordinate system to a mount and object system, and a method of imaging a mount and 
object system using an intrinsic coordinate system as above, but does not particularly disclose 
the followings: 

(a) wherein the first and second images, being simultaneously displayed, are 
superimposed one on the other as claimed in claim 32; and 

(b) identifying an identical feature on each series of images, placing a cross hair on the 
identical feature on each series of the images, and defining the center of the cross hair as being 
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the same location on each set of images so as to modify the intrinsic coordinate system as 
claimed in claim 50. 

Regarding (a) and (b), Spigarelli et al discloses a placement system using a split imaging 
system coaxially coupled to a component pickup means as shown in Figures 4 and 7, and teaches 
the conventional superimposing of images for simultaneous display (see column 4, lines 21-44, 
column 11, lines 4-10, lines 39-50, column 12, lines 10-51) as well as the use of cross hairs for 
identifying position locations (see column 22, line 66 to column 23, line 7). Therefore, it would 
have been obvious to one of ordinary skill in the art, having the Bacus et al, Kley, Engelhardt, 
and Spigarelli et al references in front of him/her and the general knowledge of imaging location 
identification and image superimposing techniques, would have had no difficulty in providing 
the simultaneous display of superimposed images and cross hair applications as taught by 
Spigarelli et al for the imaging system of Bacus for the same well known imaging identification 
and superimposing of images purposes as claimed. 

9. Claim 33 is rejected under 35 U.S.C. 103(a) as being.unpatentable over the combination 
of Bacus et al, Kley, and Engelhardt as applied to claims 1-8, 11-13, 15-21, 23-31, 34, 35, 38-49, 
51, 53, 55-57, 59, 61, and 62 in the above paragraph (6), and further in view of Hellmuth et al of 
record (5,795,295). 

The combination of Bacus et al, Kley, and Engelhardt discloses substantially the same 
data acquisition and display system, image data storage device, acquisition and display 
coordinator and method, method of display of data acquired in at least two data acquisition 
methods from a scannable field of interest, method of constructing an image gathering and 
display coordination system, control system for controlling an image data acquisition device, a 
control system for controlling an imaging device and a display device, a method of applying an 
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intrinsic coordinate system to a mount and object system, and a method of imaging a mount and 
object system using an intrinsic coordinate system as above, but does not particularly disclose 
wherein the simultaneously displayed images are displayed side by side. Side by side displaying 
of simultaneous displayed images are however old and well recognized in the art, as exemplified 
by Hellmuth et al (see column 8, lines 13-28). Therefore, it would have been obvious to one of 
ordinary skill in the art, having the Bacus et al, Kley, Engelhardt, and Hellmuth et al references 
in front of him/her and the general knowledge of image displaying techniques, would have had 
no difficulty in providing the simultaneous display of images side by side as taught by Hellmuth 
et al for the imaging system of Bacus for the same well known imaging purposes as claimed. 
10. Claims 52, 54, 58, and 60 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
the combination of Bacus et al, Kley, and Engelhardt as applied to claims 1-8, 11-13, 15-21, 23- 
31, 34, 35, 38-49, 51, 53, 55-57, 59, 61, and 62 in the above paragraph (6), and further in view of 
Yamamoto et al (5,624,798). 

The combination of Bacus et al, Kley, and Engelhardt discloses substantially the same 
data acquisition and display system, image data storage device, acquisition and display 
coordinator and method, method of display of data acquired in at least two data acquisition 
methods from a scannable field of interest, method of constructing an image gathering and 
display coordination system, control system for controlling an image data acquisition device, a 
control system for controlling an imaging device and a display device, a method of applying an 
intrinsic coordinate system to a mount and object system, and a method of imaging a mount and 
object system using an intrinsic coordinate system as above, but does not particularly disclose 
wherein the first and second data acquisition methods respectively comprise applying different 
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staining systems to the biological entity and wherein one of the staining systems is fluorescent 
staining as claimed in claims 52, 54, 58, and 60. However, Yamamoto et al discloses a detection 
method of nucleic acid by use of fluorescent pyrylium stain in intercalation into nucleic acids 
and teaches the conventional use of the application of different staining systems to biological 
entities and fluorescent staining systems (see column 2, lines 16-54). Therefore, it would have 
been obvious to one of ordinary skill in the art, having the Bacus et al, Kley, Engelhardt, and 
Yamamoto et al references in front of him/her and the general knowledge of the staining of 
biological entities for microscopic imagings, would have had no difficulty in providing the 
different staining systems including the fluorescent staining as taught by Yamamoto et al to the 
biological entities within the first and second data acquisitions of Bacus et al for the same well 
known highlighting of the presence of absence of certain types or features of bacteria or other 
biological material that is helpful to the technician purposes as claimed. 
1 1 . Due to the above new grounds of rejections, the Examiner wants to point out that only 
pertinent arguments from the amendment filed June 27, 2003 will be addressed. 

Regarding the applicants' arguments at page 15 of the amendment filed June 27, 2003 
concerning that neither Kley nor Bacus disclose the key point that image location is separately 
gathered using different image gathering combinations in such a way as to collect location data 
so that the two images can be integrated using a single co-ordinate system", the Examiner 
respectfully disagrees. It is submitted that Bacus et al teaches the particular use of X and Y 
screen points for the particular identification of selected regions (see column 9, lines 36-67). 
And since Bacus et al teaches low and high magnifications of images (see column 3, lines 33-42, 
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column 4, line 31 to column 5, line 18), such magnifications provides substantially the same if 
not the same different image gathering combinations as claimed. 

Regarding the applicants' arguments at pages 15-16 of the amendment filed June 27, 
2003 concerning that "... There has been a long-felt want for a solution that allowed automatic 
navigation between the different images, and the hardware of Kley has existed for twenty three 
years, yet the combination suggested by the Examiner, the co-ordinate system of Bacus with the 
multiple imaging of Kley was never made. The reason is believed to be because a simple 
application of the co-ordinate system between the two images does not work . . .", the Examiner 
wants to point out that though the co-ordinate system of Bacus with the multiple imaging of Kley 
may not have been made previously, it does not show non-obviousness to combine Bacus et al 
and Kley. 

Regarding the applicants' arguments at pages 15-16 of the amendment filed June 27, 
2003 concerning that "... Claim 30 requires that the first image data is stored with field location 
data. That is to say the location data relates to the positioning of the microscope relative to the 
object and is not co-ordinate data derived from the image . . .", the Examiner wants to point out 
that: The Specification is not the measure of invention. Therefore, limitations contained therein 
can not be read into the claims for the purpose of avoiding the prior art. In re Sporck, 55 CCPA 
743, 386 F.2d 924, 155 USPQ 687 (1968). Bacus et al, by storing the X and Y screen points 
indicating the selection points of interest (see column 8, lines 26-36, column 9, lines 36-58), 
nevertheless provides substantially the same if not the same storage of the data with field 
location data as claimed. 
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Regarding the applicants' arguments at page 17 of the amendment filed June 27 5 2003 
concerning in general that neither Bacus nor Kley teach or suggest identifying structural features 
that are likely to be the same between two different images of the same object obtained from two 
different imaging systems, the Examiner respectfully disagrees. It is submitted that Bacus, by 
producing low magnification and high magnification of images as selected by a user provides 
substantially the same if not the same identification of structural features between two different 
images of the same object obtained from two different imaging systems (see column 3, lines 33- 
42, column 4, line 31 to column 5, line 58, column 8, line 61 to column 9, line 15). 
12. Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 872-9314, (for formal communications intended for entry) 

(for informal or draft communications, please label "PROPOSED" or "DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington. VA., Sixth Floor (Receptionist). 



13. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Richard Lee whose telephone number is (703) 308-6612. The 
Examiner can normally be reached on Monday to Friday from 8:00 a.m. to 5:30 p.m, with 
alternate Fridays off. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group customer service whose telephone number is (703) 306-0377. 
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